Abstract: Weather plays an important role in every aspect of human life. It has direct impact on every section of human society. Weather forecast has lot of importance in agriculture sector, tourism sector and government agencies. Prior knowledge of weather can be very helpful for human to prepare themselves for any undesirable condition of climate. Various weather parameters like temperature, pressure, humidity, wind speed etc. plays an important role in the analysis of whether condition. Weather data from various sensors for various weather parameters are being generated at huge scale and in future this data will continue to grow. Big Data Analytics technology like Hadoop MapReduce and Spark are playing great role in handling huge amount of data. MapReduce has proven to be useful for batch processing while Spark has proven to be highly efficient in In-Memory Computing. This project aims to study the analytics of weather data using MapReduce and Spark.
Keywords: Hadoop, MapReduce, HDFS, Spark, Weather Data Analytics.